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(57) Abstract: 

PROBLEM TO BE SOLVED: To 
enable a caller and an operator to 
have a conversation using video and 
sound by providing a telephone signal 
connecting means which connects a 
received telephone signal with video 
to the operator. 

SOLUTION: When a caller telephone 
calls a computer telephone device 1 
by a television telephone 4 connected 
to a telephone network 8, a video and 
sound answering board 20 receives 
the signal with video. The device 
driver of the video and sound 
answering board 20 processes a 
telephone number with video by a 
telephone control circuit. At this time, 
a telephone control circuit separates 
the video and sound when the 
telephone signal is accompanied by 
the video. In this case, the video 
signal is decoded by a video 
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processing circuit and then stored in a 
memory. Further, the sound signal is 
stored in the memory as it is. Then 
the telephone control circuit instructs 
an extension telephone connection 
board 21 to connect the incoming 
telephone signal to the television 
telephone 6 of the operator #2. 
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3 tc x u emtgta^*^/cif r «tj&-t ft ct ^ tc c -c 
[0043] *^©^2 . «Ttc. ^m<omm<om 

SS2*0ffi*#MU"CSi?8f ft. H5tt*«^tC«ftH 
SS©3g.«2©Kf s *3Sfj£=J>ta-* • fU7*--g 
50 igC^T-A^^^rH-C^ft. l3 5tC*JCiT. IB 
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7«LAN, 8 (Smii^r 19«LAN7?r 

issu 2 i «rt«amtss^- ft, igiiff^£W*§i 

[0 04 4] @6«13 1 CC^Ttff^ttjSn^fc^--* 

6CC*j^T, 11. 12teCPU*-h\ 
tf*-h\ Ud^X^'Jv^K, 1 51* I/OSHJiSP 
#-F\ 16tt^n^U-C, CPU#-F1 1, 1 
2. F 1 3. /<X:/y F 1 4tti/X 

f-A^X 1 6*^L'Tf s -ir(6aS*ff9. 17«l/0 
;Ut, y ^ 5*#- F 1 4 . I /0«l»#- F 1 

5iLAN*- F 1 9*s&tt3ti&. 18BSCSI/< 
Xt, f^^gI2 3-2 6#«SS3*l6o 2 2teC 

t i /ur, A^msm-^^rtJS^isSj^^- F 2 1 * 
^L-c^u-drcdsat-r*. 2 7 ttRfltenitf- f 20 

[0 04 5] H3«H ltca^tr^jnta^t:*-* 
• fl/7 ♦i-SBBOWRS^aSS^- F©««**-r 

^D^at*S. 03CC:fol>T, 3 l«0iB*OfflIll 
» k 3 2IJCTI 'tXflffiftBHL 3 3 IMBMMbK. 
3 4«efe«ffiSlHl8S. 3 5B«^«nBB. 3 61*^* 
■J. 3 7(JMX-^'j7^ 3 8BCPU, 39te^*r 

y, 4 0ten-#;ws*ftj«gffir&&o 

[0 04 6] 41 iiCT I CT I ><*M» 

@8§3 2CCfti&<**i*o 4 2«K«t^^t, mtSSiJ 30 
MB3 3. tt«MUatt3 4. mt&BBH3 5> ^ 
^■;36, 7Vvi?37 UtRMfr*'** 4 2 *r/M/ 

vS/37. CPU3 8, y*'J39 % D-*7;1»^;*$!J®J 
I5I8S4 0 tta-*MU/<X 4 3 t^LTf*- 4Kj££ff 
5„ 4 4ttl/0^xr, D-*JU^«|ffliaB4 0^ 

[OO47]04«@1 iC7S-rSg^CD«^^^*r^n 9 
^t*S, 04CC*$C^r. 5 1BCPU#-F, 52 

tty^eytf-F. 5 3tt^';9S/#-Kr*s. 5 40 

4«I/04«BI#-F. 5 5ttI/OSU»#-F5 4CC 

wttsti. &-oo s&ftmz titer < 56t* 

L A N 7 tC^i^ $ titc LAN^- FT*4. 
[0 04 8] CCt 4 mffrJB8£0 t:f s *»jSa>tA 

[004 9] sbm 8 ic8i£<* n/cf- U tTSS4 J: 0 A 
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-£S 1 <DMkmC»K~ K 2 oa»8Mgl*<¥5Sf§<I 
J»**flr>~&. IMMmESiK~F2 0«>9''<4XF9 
-fyttjc. C©«S«-^«r!*«^I&S#- K 2 0 Oil 
fM8P[U8g3 1 . CT I /<*fWMn]8§3 2*^0-C^5*IJ 

^usg3 3-c^a-r^. 

[0050] BttMflPSBg3 1 «. JMNMie**!?— 

I£$IJ«b]883 3 MM&ft9ttI£fi4rcft&tt&tC». 
W*i#J*©#«*fT5. RMHItt. K4M&HI1B3 

nm*. *©ssy*y 3 6 ->x^a 
t*. y*y 3 6«:satfci!»^m^. nmn3 

3. CT I f^Mtmtt3 2. a-*;UMX$)Jai[lSg4 

0. i/o/ui 7*^ur»«sai#-K2 7«:teai 

[005 1 ] tfcftBtttf- F 2 7 «. 9fc«S©7 I — AW 

fI*K:*tOTi£<rrs. JMttttett. 
F2 OOf/t-T^ • F^-f^J^f-A*^^^ 9-te 

wssjk- f 2 o Kcatr 4. 
[ o o 5 2 ] acec. f 2 o onmfflw 

UK 3 3«^K^ ?fe-S/*CT I ^$WiK3 2, 
B««»PB»3 i*?>oriWl««:a«r4. 3 
BBMVBB3 3tt. CT I 2. CT I 

3*»ji4 1. CTI/U2 2^Lt. l*i*gmfSJ£& 
jK-F2 nc*tu-c. A5femfifI#**^l'-*#3© 

[0053] tTf : ^^tC.3>f^-$ • 7-U7*--g 
S 1 ©W/SlSSstf- F 2 0 5«Se*©*« 
£fr fcB$«&> U- 2 # 3 ©7* U tmiS 1 0 CC« 

tern. s*y3 etcsastittw. *-iu-*#3©7 v 

UtrmtSl 0CCfi&K3tl/c«p*-C. 3 6©U5«=& 

HMSifflSlHllg 3 4 cc -css^^k U . > * U 3 6 
iifcCC. mtS$IJSlllSS3 3, CT I -»^«IfflllIIS3 
2. CT I 3***4 1. CT1^22. rt^mtS^ 
«|iK-K2 l€r7>L"C. *^U-*# 3©f Uttffi 1 
OKKStS. 

[0 05 4] */c. RNfCC. »<t#©SSKI^*»€»«{i 
^4^5£-r2>fc*«:. tt$8*7 r .*X*£g2 4F*i©JKg 
t*-**^^*. i'^^AJi. C©SSSr-*?rLA 
N#-K19. LAN7. +^U-*#3©^9©L 
AN!j<-F5 8gS-CSS*9©Bra±«C«^r4. C© 
«f^-C. ^fs^i*'<U-*#3«f-U^miSl 
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m3tltc : f-■$t^t7 : ^ *.t>&m.2 Annuls? . 

[0 05 5] 1816198 £*) Vftttfoa^V • T 

i> y * - - mm i cc a* b tern® *w *> n&m^vyusi 
i^xmwtz. 10 

[0056] ^liiJ88CC}gi8$ft/cf-Uk-SI§4 J:926 

1 ©Bfcift^Ifcgtf- F 2 0 5 IgfSfl 

■^*Slfr S. F 2 0 <D^J< A X F 7 

-f ;<B. C ©HiSfl-si'&lfc&^It^tf- F 2 0 OBtt 
fW[aSS3 1 . CT I ><*IWffll[!K3 2*^L-C^IS*IJ 
WelSS3 3-C«iffl-ra. 

[0057] |5|i|g$lJiSllHl883 1 B. «e**S*^-9— 
f*T^ft-5&<a#©#*f£^-?7 7 »J>y-T4. S 20 
g*UfflHll!S3 3 5 «&m^"C* 

4tcra-9<t3nfca > j<* <; 3 6 cessans. ^ 

B. > * 3 6 tcgfS . StfSfMSPIsISS 3 

3. CT I KXWttmXkZ 2. o-*7JW<XiWffllg|8&4 

o. \/o>*x\i*i\Lx&m8&#-\ : 2iicum 

[0 058] mimm*- F 2 7 B. SM*©? U- AR8 

^^u-^©o^-f>. oy^srtgjg-r*. c© 
«^b. iMig*^u-*Bay*7#sg©fc«>. ^cec. 

^§&©#fcli^K:*ti6-r 5B*»4f* 5 > ? -b - ^©Wfl&£ 

[0 059] ftte. *^U-*B. fig?r(8tv*B#<t)SE«: 

r-ABC©t#«*LAN7|IlS3'C§WIX<3. TWXfiS 40 
B2 5j*J©^U-ftttl7— ^*j£SKifr4. * 

2 5 «©*-< U- iHBg^- * {C*8^-T4. 

[0 060] ^K^ft««:*tr-S> ?-b-i?*s&i>tg£ 

6*JlS</c3l». J 3E©B*»£i¥5j< ?-b-S?*#lft# 
B. ltF«>orJg«t$n/c±fertS©&ihiii(fe. so 
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[0 06 1 ] HfctfjKB. SWRSWfcSaK- F2 0©^ 

fib. ^ft£i!fSI88^&mT*fc&&c^{|!^m§tf 
-F2 0K:3£jrrS„ *JC. 8Mft§|S|og#-F2 0© 

^is$ihsj3 3«s^> y*-v>iCT i /<x*ijmh]883 
2. @^S)jia)iis83 i zftLxftm%icmm-rz>. * 

F2 0#§fIU lslWiai|51SS3 1, CT1 sttMBH 
883 2. a-*JU^^$flffll[lS84 O^L. VX^ACC 
?l#?g-r. ->X^AB. ^&©BMfc£#5.^-b-->>£ 

[0 06 2 ] ^K2fe«i§CC*t-f S> vM-'Jifi&Zm-gi 

#trsv*-r©-cc:s£</c;*c>. j i?©|)im*#^^ » 

■b-^^^M^tC^LrjUffri. C©l§£©l8fegt*f* 

B5 1 r mts 3 n/c±iBF*is©»±iii 

[0063] Kflt«^{&SiK- F 2 0 ©t 1 

• F7-f^«^f-A*>e,©SK> yb-^4S 

iu -5-n*«isffl8^jii(trs/c»cc^«^icsd< 

-F2 0{Cfe^-rS. ^CtC. F 2 0 

«. v-b-i?*D-*;U^^*ilSIIIilSS4 0. CT 

I;<*aKISP|5I883 2. mS$fl©[5|8g3 3^%/rLT. - 
fi^ * «J 3 6 (Ctgtt L . »5«j!5a@8S 3 4 . ^^SIhI 
883 5{crf-l/b-^ia©!!«i»7*-v^ K m?*?*- 
77 htc^jftb. «fS*»Jtai[5]?S3 3. CT I >i*MW\Bl 
S83 2. @«l$fJa)@S83 1 ZftLX&mmttC&mtZ. 

[0 06 4] se.ee. mBgDwmz&u 

*L/c6*Jg</c3l>. J ^©^ y-b-^^m^tcjH 
ff-r*. C©»^©K{S«rf*^^ 9-b-S?B. BtTfcoT 
3 *ifc±t2rtS:©^ltiS. -5 tcim* v -b 

fs«©^ » -b- i?*lSl5«#^^ v -b - V> • d< i» X (cm 

?rr&. ^ti^jccB. e«5«^ic;sd<- f 2 o©^^ 
x • F-5^^tt^f-A3&»e.©sa> »-b-y*s© 
o. -eti*miS!H38-^ffrsfc*ccK®!^jc.s^- 
F2o«:iss-r-s.. 

[006 5] ©fe^^^C&S^— F 2 0 B. ^> 

vte-V>&a-*})\,J<Zfflffl®d&4 0. C T I ^'X$IJ®I 
0883 2. ^§$(Ka)@883 3 44/M/-C. — fiy*'J3 
6CCtSiWU K«jaS@883 4. §^«iS[1883 5«:r 
x U tmi§©l&®:7 * » h . er^7 * -v h (Cg! 
8SU msS$0@Iia883 3. CT I ^'X$iitai[e]S83 2. HI 
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<sniijM5iss3 i zitL-c&m%tcmm?2>. &m%<Dm 
»isiffi3 i . ct i /<zfmmi&3 2*ftLxmszm 
[0 066] mffl\'&®&33 immzw ^mssmn-c 

fasti*. -eco* 3 6«:ss3n 

#J»lS5Sslf-F2 0*>6«W»»). f^?gg25l«3 10 
[0067] C ©<fc 5 K. **JS©f^S8-C«. SISIS 8 

icfeia-r-sB*. ^fs©T*s*^w-*##it.-c* 

[0 068] ft**. ±BSSItfi©Jfc!&2 "Ctt. HfS«88 J; 20 
«fc 5 (CLT 

[0 069] HflS©ff5Sg3 . JSTFtC. *¥kW<Dmt&<Dm 
S§3*0S«r#MLrstt^TS. **!6©JB9g«. 131 

*--gg©~>X^AW££l5l;|$T*>S©r. 0141 

t>TBMU-r*. hi {c*ji>r. nie^^fjcn^b-a. 30 

-jt-fU7*i-«i. 2. 3«if§*. 4. 6«^U 
e^ts. 5«r^aymis. 7«LAN. 8USI5M-C 
19BLAN7 4/MT^2, 3 <LJ8te3ftS 
fcrf^jttJorai/fcV-* • fl/7*--ggl©LAN 
iK-F. 2 0BIMl«n&SiK--h"C. «HM8*»6«) 

-FT. WBd-***MH&«:*ttTS. 
[0 07 0] H7«Hl«:^-rf7 ; **]lS=i>b-»-f 
•7-U7*i-^g(D»SS;«:7Kr^cif fH"C*S„ H 
7«Cfcl»-C. 11. 12ttCPU#-K. 1 3tt>t'J 40 

f. 14 ^ v y F . 1 5 « I /OiWfflJ 
#-F. 1 6«^7-A^UT. CPUsK-Fll. 1 
2, V F 1 3 . ? F 1 4 «>X 

irA^* 1 e&rt-L-r^-fiiteigSrtT^. 17BI/0 
rt ') v F 1 4 . I /OMWtf- F 1 
5<kLANsK-Fl 9*iS«l3nS. 18BSCS1A 

f 1 -* **igg2 3-2 e&mmztiz. 2 2«c 
t i ximi&m^if*im.?m&mfo#- F2 1 * 

•c. ©«i§<i-^©^>3£i2i£-rs. so 
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[0071] B3«ai«:sTm»K3>i; a -ii 

^a^HT&S. H3&c*si,>-c. 3 l iilliSSil®lel 
?8. 3 2BCT! ^*3HHS)Ih)!8. 3 3 «^IS»|5IS8. 
3 4B^«5!iaiPlS8. 3 5«#^a@S8. 3 6B^t 
'J. 3 7B^-^'J»y t 3 8BCPU. 3 9B>* 

■;. 4 0tta-#;i/^*$w@SSr&£>. 

[0 07 2] 4 1BCT I -C. CT I -KXfBJffil 

@S83 2{C«i^3n.5„ 4 2B|ft^ ; &^>'^-C. mt§*lJ 

Weiss 3 3 . <m&f&mmt& 3 4 . ^mmm^3 5 . > 

* 3 6 . MX^tj,y3 7 ttRflttPLfCX 4 2?:/ft 
T^-ffcit*^. 4 3BP-**'«t. /<x^y 
7^37, CPU38, 39. U-ij )\>>ixym 

!slif84 0Ba-*;UM*X4 3 ZftbXf-Z&MZft 
5. 4 4B I /0^^"C, 0-*;^<X$lJffiIlI8S4 0*5 

[ 0 0 7 3 ] H 4 «H 1 {C^-TJg*©^*^ ^"a v 
d?H-C«>S„ H4tC*il ( ir, 5 1«CPU#-F. 52 
F. 5 3W*Z-?'J Ft?**. 5 

41* I /OftU8PsJ<— F. 5 5 « I /OW»jK- F 5 4 tc 
^M$n, ioOS^SWcf-iX^gl, 5 6B 
LAN7{CSS^SnfcLAN^- FT**. 
[0 07 4] CCT, miSiW8 f f«3>f» 
• ^U7*^-£glCCA*0fc^8**fl^mi£fI 

[0 07 5] mtS«l8(C^Snfcr-UfmiS4J:0» 

F 2 0 tflfcf&fcftOmfifi^Sfrf S. 
WMWCSjK- F 2 OOf/WX F 9 C©lfc 

F 2 0 ©0^*11© 

SSS3 1. CT I ^*3HJM3883 2 */M/-C^fS*lJiai[Hl 

883 3-c®a-rs. 

[0076] ®mmwM&3 i ». ^m*mis##-y-- 

i§*fjffliiHifS3 3 «Kiet*f#^mani#-c*-2>«^«:«. 

4K.xmmt2tiK.'&. ^t'j3 6tcia3n5. ^ 
mmt. *©**>*•; 3 6(csa$n-s. ^ctc. mt§ 

SH®lilS83 3«. CT I^*$W®8&3 2. CT I 3* 
?*41, CTI^224/fOt, (*3il9miS&i&#- 
K2 ltC*tL-C. A*maif^*^U— f #2©f U 

trms 6 icm&? z> <fc ^ ects^r s. 

[0 07 7] bf : ^*flc.3>f*-a' • rU7*^-g 
g 1 ©^^lS§^- F 2 0 ^m*^ ^^IS<l#*§fi 

^ tcmg.fr e.*-^u-*#2©7-u bmi§ 6 tc«^ 

T-SSrOlft^tt. lfc«SttSI18S3 4(C-Cffl#<t3ti/c 
f^. 3 6tCSS3*aiBIW. ^^U-f#2©7-U 
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tr^i§6 tcm&ztitcft&v. jt -* 'j 3 6 ©ewssfcefttsi 

tec. ^mmmz 3 3 . ct i;<*§r<sjus83 2. c 
Ti3*9^4i. c t i 2 2 . ftm&mmm*- 
F2 lfcftb-c. *^u-£#2©:ru£SlS6fc:$Kj£ 

[oo78]*fc. mmc sft©®stf*e>is 

#*WS"f*te«E>«:. te$R£7 : w**iSg2 4rt©J8g: 
T-Z&&m-?Z>. is*.7-Mt. C©JSg^-*£LA 
N#-F19, LAN7. # 2©*S;fc3©L 10 

AN^-F5 6igfi-CJffi^3©i®®±K:^-rS. C© 
Bfc£-C. 2Hf#<L*'<U-*#2tt^Utmi§6£:»U 
■C^iS^P^-r*^. *'"<U-*#2©tfc8iS:{*5mi§ 
ff-^ti. flUlliilfctf- F 2 1 . !/0^17^lt 
tfcft#?'£S'K~ F 2 0 IC&M P - ftJU'txtMP 
0884 0. CTIMXMttSBSZ&^lTttBMflPB 
S83 3-CftiaS*l-5. 

[0 079] «B1M«BB 3 3 9 MSH*? 

*-SJS^{C«. 8M*i^©#tt*?T5. RfltflPtK. 

R««ffllllB3 4«:-ca#<k3ti/ca. ^*>;3 6«:S 20 
«sn*. *WHnatt3 4<cc«*Mts 

3 6 KttMStifcW*. «SMMB3 3 . C T I n 
*#J®0!J83 2. n-#;w?x$iJtSiB884 0. I/O'* 
*1 7*rtt/T:. *PB0fcK-F2 8CC«»-*-&. 
[0 080] **H«W?- F 2 8 ». *P«BIU ft 
•#«85#- F 2 0 (c^?5>J«t LtMt. ft«#^lE 

f 2 0 ©?*>< -fxK7^f #?&sate* (X 

33*J) *>*'J3 6CCtSiMSnfc^l/-f #2©ft« 
&#J*r4. ft#*>HffiB883 4. WttBR 30 

3 5KXfU£S8S©8Mfe7*--v? F. ^J*?*—? 
F CCSftl,. «BmiBK3 3, CTI ><*fM8PB8S 

32. BWHMaisa i*^o-c*«*tcsm-r*. 

[0 08 1] C©«t^{C. *3§j6©J&«"Ctt. mtS«8 
*l//cft»£f* ^^fSd-^*^ U eHf£6 S*^ 
SNMSS£ftftCc6i£Lrftfi#tcj£flrrs C # 
[0 082] fcfc. ±I2JISS©fiJS83 TB. ^85*18 J: 40 
L fcmtifs^* f U tfUS 6 4 CI * 5 U - f CCffiR 

[0 083] XttO£S4 . fclTtC. *«IS©HS6©JB 
«c^-mss©^.®i ©trf t *Jttlt.=i>t»-* • ?l/7 

♦--gg©^*^ A«teEiH«r*s©-c. aui 
c»r»WT4. s 1 (c*jt>r. 1 «tr <r*nfca >e» so 
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• ^L>7*^-£g. 2. 3ttJg5t?. 4. 6it7-l< 
fmii. 5«T^ai/mii. 7BLAN, 8ttSiS«-C 
*4. 1 9(JLAN7 4^L--C^5|52. 3££i&<?*lS 
tff^J-fcHtave*--* • 7 1 U7*--8gl©LAN 
#- F. 2 0«5ft«#^(t.§^- FT. «8§8l8*>fc© 

-Ft?. «fifl4«#««B(Ctttt-r&. 

[0 08 4] ia8(j@ KCTF-rtr^^it.^^fjL-* 

8tC*Jt»r. 11. 12BCPUsK-F. 13«>*'J 
F. 1 4 tt><*y «J f 5?jK- F. 1 5 « 1 /OU® 
jK— F. 1 6«->XfA;Ut?, CPU#-F1 1. 1 
2 . V sK- F 1 3 . ;U7>; ? F 1 4 ttV* 

[0085] 1 7 « 1 /c»<x-e. » ^=J<- F 

14. I/OMtthK-Fl 5£LAN*-F19*H£*£ 
<*tt£. 18BSCS1/UT. f^?KI23~2 
6#*8i&;*tt£. 2 2ttCTlA*XT. A*mf§M#* 

F2 1 */M^-c*^u-^{c«gjM-r 

5. 2 8 (J^jSsgSStf- F-C. *-^U-^©miSfi^© 
2 9«^iS^^-Fr. ^fi#©^l£ 

[0 08 6] laSttSllCin-rtf'^lt^Vfa.-^ 

•fU7* --^g©?sii«^i£;§#- F©«fi£*^-r 
^d^^^-c**. 03{c*sc»-c. 3 1 izmmnwm 

88. 3 2 «CT I /^SiHai@8S. 3 3 «^i£IW®![a]88. 
3 4«|ti«J!iffi[lK. 3 5«^KkSlB]S8. 3 6t^t 
V. 3 7ttA^ • zfi) yi>. 3 88CPU, 3 9«>* 

[0 08 7] 4 1BCTI a*d»f-C. CT I >l7>%m 
lslS83 2K:^sn€.. 4 2«8H«^^r. mtSSiJ 
8P1I!8 3 3 . W«ffiSlI883 4 . #^®a(18S3 5 . 
*U 3 6 . '<X7<) v i>3 IWm&JSj-tXA 2 £/CU 

-;i>3 7. CPU38, ^*'J3 9. D-*^s^*fl© 
|5I884 0Ba-*Jl'^'X4 3^Ltf-^4tf 
^. 4 4BI/0^-C, D-*;U^'^flJffll|5lSS4 0*i 

[ 0 0 8 8 ] m 4 »s 1 «c*jvr ^©fltfiXfc^-r •» 

04{C*Jt>r. 5 1«CPUil<-F. 5 2 
itjt * rK— F . 5 3 i J'<* ^ ') v V>^- F"C* S„ 5 
4 li I /OSfliSI^- F . 5 5 « 1 /0*«81*- H5 4K 

sei^ti. froostfteirtsnfcT^ xd?^g. 5 6« 

LAN7fcM3titeLAN!j<- Fr*^. 
[0 08 9] CC-C. fi!S*38<fc9 f f^WtEa^t* 

^©IU^«:$StxS#i5*l2^L.. ^S©S^« (X 
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[0 09 0 1 SfS838CC*8*&<*tt;fcxUtfmiS4 

(s##ttf r *s*i&3>fa-d' • fi/7^-ggi«: 

-£SS 1 ©8Mfcttf5lt.g*- F 2 O#0«fc£<*^i§{i 
^Sft^i. W*#W6S#- F2 OCt^W * F^ 
A}i t C ©tUSd^^&^togtf- K 2 0 (OMm 

%mms&3 i . ct i ^^u&m^3 2iftLxm^m 

[0 09 1 ] @^J©IhI8S3 1 «. &[g#HI£#-stlJ-- 
tr*-cf#6tt.2>&{i;g©##£^ ?7 r V> if~?2>. ^ 10 
l§*W|5I?83 3 «lft»^(*^mt§fB^-C*S^{C«. 

l^tt, *©£$j<*D 3 6&tg«<**lS. i'XfZ, 
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(57) [Abstract] 

[Technical problem] After connecting with a reception side from a 
customer side, it is realizable to once put connection on hold, without 
intervening means of communications, or to transmit to another reception 
side etc. 

[Means for Solution] From a telephone network 8, the image audio 
response board 20 receives the telephone signal accompanied by the image 
which carries out Iriki, answers based on the telephone signal 
accompanied by this received image, and it constitutes the extension- 
telephone connection board 21 so that the telephone signal accompanied 
by this received image may be connected to an operator. 
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CLAIMS 



[Claim(s)] 

[Claim 1] The CPU board which is characterized by providing the 
following and with which the processor was mounted, The system bus to 
which the CPU board was connected, and the memory board connected to the 
system bus, The system bridge board which performs the bridge to an I/O 
bus, and an I/O-hardware-control board, The I/O bus to which the I/O- 



hardware-control board was connected, and the disk unit connected to the 
I/O-hardware-control board, Computer telephony equipment corresponding 
to the video which has the board of each component, the power supply 
unit which supplies a power source to a disk unit, and the system 
management board which performs management of a system A telephone- 
signal receiving means to receive the telephone signal accompanied by 
the image which carries out Iriki from a telephone network A telephone- 
signal response means to answer based on the telephone signal 
accompanied by the received image The telephone-signal connecting means 
which connects the telephone signal accompanied by the received image to 
an operator 

[Claim 2] Computer telephony equipment corresponding to the video 
characterized by ****** which has the telephone-signal automatic 
connecting means which carries out automatic connection to an operator 
based on the contents of the image recognized to be an image recognition 
means to recognize the image which carries out Iriki from a telephone 
network in the computer telephony equipment according to claim 1 
corresponding to video when connecting the telephone signal accompanied 
by the received image to an operator. 

[Claim 3] Computer telephony equipment corresponding to the video 
characterized by having a speech recognition means to recognize an 
operator s voice, and a speech recognition result composition means to 
compound a speech recognition result on the image transmitted to an 
addresser when an operator' s voice has been recognized in the computer 
telephony equipment according to claim 1 corresponding to video. 
[Claim 4] Computer telephony equipment corresponding to the video 
characterized by having a sign language recognition means to recognize 
the sign language contained in the image which carries out Iriki from a 
telephone network in the computer telephony equipment according to claim 
1 to 2 corresponding to video, and a sign language recognition result 
composition means to compound the recognized sign language recognition 
result on an image in case the telephone signal accompanied by an image 
is connected to an operator. 

[Claim 5] Computer telephony equipment corresponding to the video which 
is a publication claim 1 thru/or 2 and 4 characterized by providing the 
following The 1st speech synthesis means which compounds voice from a 
character string A sign language recognition means to recognize the sign 
language contained in the image which carries out Iriki from a telephone 
network The 2nd speech synthesis means compounded to the voice of the 
telephone signal which synthesized voice with the 1st speech synthesis 
means, and carried out [ voice / this / that was compounded ] Iriki from 





the sign language recognition result recognized by the sign language 
recognition means when connecting a telephone signal to an operator 



[Translation done. ] 
* NOTICES * 
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DETAILED DESCRIPTION 



[Detailed Description of the Invention] 
[0001] 

[Field of the Invention] This invention relates to the computer 
telephony equipment corresponding to video, and relates to the computer 
telephony equipment corresponding to the video which processes the Iriki 
telephone from a telephone network in detail. 
[0002] 

[Description of the Prior Art] Conventionally, about a reception system, 
there are some which were reported, for example by JP, 9-163031, A. 
Hereafter, it explains using a drawing concretely. Drawing 10 is the 
schematic diagram showing the conventional reception structure of a 
system, drawing 10 — setting — 100a and 100b — for an indicating 
equipment, and 116a and 116b, a touch panel and 118a are [ a terminal 
unit and 112 / a communication line, and 114a and 114b / the field of 
the screen of indicating-equipment 114a, and 120b and 122b of a 
television camera, and 120a and 122a ] the fields of the screen of 
indicating-equipment 114b. 

[0003] This conventional reception system is explained. A reception 
member and a customer can talk mutually with the conversation equipment 
inside terminal units 100a and 100b. Television camera 118a photos the 
reception member which is before terminal unit 100a, and also photos the 
related information of goods and others to a reception member side, and 
sends the picture signal to terminal unit 100b by the side of a customer 
through a communication line 112. 



[0004] The image photoed by indicating equipments 114a and 114b by 
television camera 118a is displayed on Fields 120a and 120b. Moreover, 
the information registered into the storage means inside terminal unit 
100a can be displayed on the fields 122a and 122b of Displays 114a and 
114b. 
[0005] 

[Problem(s) to be Solved by the Invention] In the conventional reception 
system which was described above, since direct continuation of the 
terminal units 100a and 100b by the side of a customer and reception was 
carried out by means of communications, after connecting with a 
reception side from a customer side, the technical problem that it could 
not perform transmitting to another putting [ without mediation of means 
of communications ]-once-connection and reception side etc. occurred. 
[0006] Then, it aims at offering the computer telephony equipment 
corresponding to the video which can realize transmitting to another 
putting [ without mediation of means of communications ]-once-connection, 
and reception side etc. , after having been made in order that this 
invention might solve the above technical problems, and connecting with 
a reception side from a customer side. 
[0007] 

[Means for Solving the Problem] The CPU board with which, as for 
invention according to claim 1, the processor was mounted, and the 
system bus to which the CPU board was connected, The memory board 
connected to the system bus, and the system bridge board which performs 
the bridge to an 1/0 bus, The I/O bus by which the 1/0-hardware-control 
board was connected with the 1/0-hardware-control board, The disk unit 
connected to the 1/0-hardware-control board, and the board of each 
component and the power supply unit which supplies a power source to a 
disk unit, In the computer telephony equipment corresponding to the 
video which has the system management board which manages a system It is 
characterized by having a telephone-signal receiving means to receive 
the telephone signal accompanied by the image which carries out Iriki 
from a telephone network, a telephone-signal response means to answer 
based on the telephone signal accompanied by the received image, and the 
telephone-signal connecting means that connects the telephone signal 
accompanied by the received image to an operator. 
[0008] In the computer telephony equipment according to claim 1 
corresponding to video, in case invention according to claim 2 connects 
an image recognition means to recognize the image which carries out 
Iriki from a telephone network, and the telephone signal accompanied by 
the received image to an operator, it is characterized by ****** which 




has the telephone-signal automatic connecting means which carries out 
automatic connection to an operator based on the contents of the 
recognized image. 

[0009] Invention according to claim 3 is characterized by having a 
speech recognition means to recognize an operator' s voice, and a speech 
recognition result composition means to compound a speech recognition 
result on the image transmitted to an addresser when an operator' s voice 
has been recognized in the computer telephony equipment according to 
claim 1 corresponding to video. 

[0010] Invention according to claim 4 is characterized by having a sign 
language recognition means to recognize the sign language contained in 
the image which carries out Iriki from a telephone network, and a sign 
language recognition result composition means to compound the recognized 
sign language recognition result on an image in case the telephone 
signal accompanied by an image is connected to an operator in the 
computer telephony equipment according to claim 1 to 2 corresponding to 
video. 

[0011] Invention according to claim 5 is set to claim 1 thru/or the 
computer telephony equipment given in 2 and 4 corresponding to video. 
The 1st speech synthesis means which compounds voice from a character 
string, and a sign language recognition means to recognize the sign 
language contained in the image which carries out Iriki from a telephone 
network, In case a telephone signal is connected to an operator, it is 
characterized by having the 2nd speech synthesis means compounded to the 
voice of the telephone signal which synthesized voice with the 1st 
speech synthesis means, and carried out [ voice / this / that was 
compounded ] Iriki from the sign language recognition result recognized 
by the sign language recognition means. 
[0012] 

[Embodiment of the Invention] Below, the gestalt of operation of this 
invention is explained with reference to a drawing. 
Gestalt 1, drawing 1 of operation is drawing showing the system 
configuration of the computer telephony equipment corresponding to video 
of the gestalt 1 of operation concerning this invention. For a terminal, 
and 4 and 6, as for an analog telephone and 7, in drawing 1 , a TV phone 
and 5 are [ the computer telephony equipment corresponding to video, and 
2 and 3 / 1 / LAN and 8 ] telephone networks. The LAN board of the 
computer telephony equipment 1 corresponding to the video by which 19 is 
connected with terminals 2 and 3 through LAN7, and 20 are image audio 
response boards, receive the Iriki telephone signal from a telephone 
network 8, and answer, and 21 is an extension-telephone connection board 



and connects a telephone signal to a wire telephone. 
[0013] Drawing 2 is the block diagram showing the configuration of the 
computer telephony equipment corresponding to the video shown in drawing 
1 . In drawing 2 , for a CPU board and 13, as for a bus bridge board and 
15, the memory board and 14 are [ 11 and 12 / an I/O-hardware-control 
board and 16 ] system buses, and CPU boards 11 and 12, the memory board 
13, and the bus bridge board 14 perform data transfer through a system 
bus 16. 17 is an I/O bus and the bus bridge board 14, the I/O-hardware- 
control board 15, and the LAN board 19 are connected. 18 is a SCSI bus 
and disk units 23-26 are connected. 22 is a CTI bus and transmits the 
Iriki telephone signal to an operator through the extension-telephone 
connection board 21. 

[0014] Drawing 3 is the block diagram showing the configuration of the 
image audio response board of the computer telephony equipment 
corresponding to the video shown in drawing 1 . drawing 3 — setting 
31 — a line control circuit and 32 — a CTI bus control circuit and 33 
— a telephone control circuit and 34 — for memory and 37, as for CPU 
and 39, a bus bridge and 38 are [ an image processing circuit and 35 / a 
speech processing circuit and 36 / memory and 40 ] local bus control 
circuits. 

[0015] 41 is a CTI connector and is connected to the CTI bus control 
circuit 32. 42 is an image voice bus and the telephone control circuit 
33, the image processing circuit 34, the speech processing circuit 35, 
memory 36, and a bus bridge 37 perform data transfer through the image 
voice bus 42. 43 is a local bus and a bus bridge 37, CPU38, memory 39, 
and the local bus control circuit 40 perform data transfer through a 
local bus 43. 44 is an I/O bus and the local bus control circuit 40 is 
connected. 

[0016] Drawing 4 is the block diagram showing the configuration of the 
terminal shown in drawing 1 . As for a CPU board and 52, in drawing 4 , 
51 is [ the memory board and 53 ] bus bridge boards. The disk unit in 
which 54 was connected to the I/O-hardware-control board, and 55 was 
connected to the 1/0-hardware-control board 54, and OS was stored, and 
56 are the LAN boards connected to LAN7. 

[0017] Here, the case where the telephone signal accompanied by the 
image which carried out Iriki to the computer telephony equipment 1 
corresponding to video from the telephone network 8 is connected to the 
operator having TV phone 6 is explained. If an addresser telephones 
computer telephony equipment 1 from TV phone 4 connected to the 
telephone network 8, the image audio response board 20 of the computer 
telephony equipment 1 corresponding to video will receive the telephone 





signal accompanied by an image. 

[0018] The device driver of the image audio response board 20 processes 
the telephone signal accompanied by this image in the telephone control 
circuit 33 through the line control circuit 31 of the image audio 
response board 20, and the CTI bus control circuit 32. At this time, the 
line control circuit 31 buffers an addresser' s number obtained with 
addresser telephone number service. The telephone control circuit 33 
performs separation of the image and voice, when it is a telephone 
signal accompanied by an image. 

[0019] After a video signal is decrypted in the image processing circuit 
34, it is accumulated in memory 36. A sound signal is accumulated in 
memory 36 as it is. Next, the telephone control circuit 33 directs that 
the Iriki telephone signal connects with TV phone 6 of operator #2 to 
the extension-telephone connection board 21 through the CTI bus control 
circuit 32, the CTI connector 41, and the CTI bus 22. 
[0020] After an image until the audio response board 20 of the computer 
telephony equipment 1 corresponding to video connects with TV phone 6 of 
operator #2 from the time of receiving the telephone signal accompanied 
by an image is decrypted in the image processing circuit 34, it 
continues being accumulated in memory 36. Subsequently, when it connects 
with TV phone 6 of operator #2, the image of memory 36 is encoded again 
in the image processing circuit 34, and it transmits to TV phone 6 of 
operator #2 with the voice of memory 36 through the telephone control 
circuit 33, the CTI bus control circuit 32, the CTI connector 41, the 
CTI bus 22, and the extension-telephone connection board 21. 
[0021] Moreover, since an addresser is specified as coincidence from an 
addresser's telephone number, the customer data applicable to the 
addresser telephone number in a disk unit 24 are searched. A system 
displays this customer data on the screen of a terminal 3 by the LAN 
board 56 course of the LAN board 19, LAN7, and the terminal 3 of 
operator #2. Although an addresser and operator #2 start conversation 
through TV phones 4 and 6 at this time, operator #2 can respond with an 
addresser, looking at an addresser' s customer data. The data updated by 
this correspondence are stored in the customer data in a disk unit 24. 
[0022] Furthermore, according to a demand of an addresser, operator #2 
can also pour a static image and a dynamic image. This static image and 
a dynamic image are data, video guidances, etc. explaining goods. 
Specifically, the static image and the dynamic image are stored in the 
disk unit 26 in the format compressed [ MPEG / JPEG, ]. A system takes 
out this static image and a dynamic image from the inside of a disk unit 
26, and transmits them to the image audio response board 20. 




[0023] Once the device driver of the image audio response board 20 
stores a static image and a dynamic image in memory 36 through the local 
bus control circuit 40, the CTI bus control circuit 32, and the 
telephone control circuit 33, it is changed into an image format of a TV 
phone, and a voice format in the image processing circuit 34 and the 
speech processing circuit 35, and transmits to an addresser through the 
telephone control circuit 33, the CTI bus control circuit 32, and the 
line control circuit 31. 

[0024] When the operator who has TV phone 6 when the telephone signal 
accompanied by an image carries out Iriki to the computer telephony 
equipment 1 corresponding to video from a telephone network 8 cannot 
respond, after transmitting the message accompanied by the image 
beforehand prepared for the addresser, the case where the message 
accompanied by an image is received from an addresser is explained. 
[0025] If an addresser telephones the computer telephony equipment 1 
corresponding to video from TV phone 4 connected to the telephone 
network 8, the image audio response board 20 of the computer telephony 
equipment 1 corresponding to video will receive the telephone signal 
accompanied by an image. The device driver of the image audio response 
board 20 processes this telephone signal in the telephone control 
circuit 33 through the line control circuit 31 of the image audio 
response board 20, and the CTI bus control circuit 32. At this time, the 
line control circuit 31 buffers an addresser' s number obtained with 
addresser telephone number service. 

[0026] The telephone control circuit 33 performs separation of an image 
and voice, when it is a telephone signal accompanied by an image. After 
a video signal is decrypted in the image processing circuit 34, it is 
accumulated in memory 36. A sound signal is accumulated in memory 36 as 
it is. A system searches the operator state table in a disk unit 25, and 
checks an operator' s log in and a log off. In this case, the operator 
concerned searches the operator customer data in a disk unit 25 for a 
log off condition next, and checks the existence of the message 
accompanied by the image corresponding to the addresser of this **. 
[0027] In addition, an operator performs a log in and a log off at a 
terminal 3, when it returns to the time of leaving a seat, and a seat, 
and a system updates suitably reception and the operator state table in 
a disk unit 25 for this information by LAN7 course. Moreover, at a 
terminal 3, an operator creates suitably the message accompanied by the 
image corresponding to a customer registered, and stores in the operator 
customer data in a disk unit 25. 

[0028] "I am sorry when the operator customer data in a disk unit 25 are 



searched and there is no message to the addresser concerned. The 
operator has removed the seat now. If there is a message, please give 
the talk. While transmitting the message accompanied by images, such as 
", to an addresser, the message accompanied by an addresser* s image is 
saved at an image voice message box. The device driver of the image 
audio response board 20 receives the message concerned from a system, 
and in order to transmit it to a telephone network 8, specifically, it 
transmits it to the image audio response board 20. 
[0029] Next, the telephone control circuit 33 of the image audio 
response board 20 transmits the message concerned to an addresser 
through the CTI bus control circuit 32 and the line control circuit 31. 
Moreover, the image audio response board 20 receives the message 
accompanied by an addresser' s image, and it hands over to a system 
through the line control circuit 31, the CTI bus control circuit 32, and 
the local bus control circuit 40. A system stores the message 
accompanied by the image of this ** in the image voice message box in a 
disk unit 25. 

[0030] "I am sorry when there is a message to the addresser concerned. 
Although they have removed the seat now, since operator #2 have a 
message addressed to you, please look at them. The message accompanied 
by images, such as ", is transmitted to an addresser. The device driver 
of the image audio response board 20 receives the message concerned from 
a system, and in order to transmit it to a telephone network 8, 
specifically, it transmits it to the image audio response .board 20. 
[0031] Next, the image audio response board 20 once stores the message 
concerned in memory 36 through the local* bus control circuit 40, the CTI 
bus control circuit 32, and telephone control circuit 33 **, changes it 
into an image format of a TV phone, and a voice format in the image 
processing circuit 34 and the speech processing circuit 35, and is 
transmitted to an addresser through the telephone control circuit 33, 
the CTI bus control circuit 32, and the line control circuit 31. 
[0032] Furthermore, in leaving the message accompanied by the image from 
an addresser, while transmitting a message, such as "give the talk if a 
message is in operator #2", to an addresser, an addresser s message is 
saved at a voice message box. The device driver of the image audio 
response board 20 receives the message concerned from a system, and in 
order to transmit it to a telephone network 8, specifically, it 
transmits it to the image audio response board 20. 

[0033] Next, the image audio response board 20 once stores the message 
concerned in memory 36 through the local bus control circuit 40, the CTI 
bus control circuit 32, and the telephone control circuit 33, changes it 




into an image format of a TV phone, and a voice format in the image 
processing circuit 34 and the speech processing circuit 35, and is 
transmitted to an addresser through the telephone control circuit 33, 
the CTI bus control circuit 32, and the line control circuit 31. The 
message accompanied by an addresser' s image is processed in the 
telephone control circuit 33 through the line control circuit 31 of the 
image audio response board 20, and the CTI bus control circuit 32. 
[0034] The telephone control circuit 33 performs separation of an image 
and voice, when it is a telephone signal accompanied by an image. After 
a video signal is decrypted in the image processing circuit 34, it is 
accumulated in memory 36. A sound signal is accumulated in memory 36 as 
it is. A system stores the message accompanied by an addresser' s image 
in the image voice message box in reception and a disk unit 25 from the 
image audio response board 20. 

[0035] When the operator who has TV phone 6 when the telephone signal 
accompanied by an image carries out Iriki to the computer telephony 
equipment 1 corresponding to video from a telephone network 8 cannot 
respond, the case where an addresser wishes correspondence of the 
operator having an analog telephone is explained. 

[0036] If an addresser telephones the computer telephony equipment 1 
corresponding to video from TV phone 4 connected to the telephone 
network 8, the image audio response board 20 of the computer telephony 
equipment 1 corresponding to video will receive the telephone signal 
accompanied by an image. The device driver of the image audio response 
board 20 processes this telephone signal in the telephone control 
circuit 33 through the line control circuit 31 of the image audio 
response board 20, and the CTI bus control circuit 32. 
[0037] The line control circuit 31 buffers an addresser's number 
obtained with addresser telephone number service. The telephone control 
circuit 33 performs separation of an image and voice, when it is a 
telephone signal accompanied by an image. After a video signal is 
decrypted in the image processing circuit 34, it is accumulated in 
memory 36. A sound signal is accumulated in memory 36 as it is. A system 
searches the operator state table in a disk unit 25, and checks an 
operator' s log in and a log off. In this case, the operator concerned 
searches the operator customer data in a disk unit 25 for a log off 
condition next, and checks the existence of the message accompanied by 
the image corresponding to the addresser of this **. 
[0038] "I am sorry when an operator cannot respond. The operator has 
removed the seat now. When correspondence by analog telephone is wished, 
please push ### of a push button. The message accompanied by images, 





such as ", is transmitted to an addresser. The device driver of the 
image audio response board 20 receives the message concerned from a 
system, and in order to transmit it to a telephone network 8, 
specifically, it transmits it to the image audio response board 20. 
[0039] Next, the image audio response board 20 once stores the message 
concerned in memory 36 through the local bus control circuit 40, the CTI 
bus control circuit 32, and telephone control circuit 33 **, changes it 
into an image format of a TV phone, and a voice format in the image 
processing circuit 34 and the speech processing circuit 35, and is 
transmitted to an addresser through the telephone control circuit 33, 
the CTI bus control circuit 32, and the line control circuit 31. To 
coincidence, the device driver of the image audio response board 20 
processes the dial tone signal by the ### depression of a push button in 
the telephone control circuit 33 through the line control circuit 31 of 
the image audio response board 20, and the CTI bus control circuit 32. 
[0040] When an addresser wishes correspondence by analog telephone, the 
device driver of the image audio response board 20 directs that the 
Iriki telephone signal connects with the analog telephone 5 of operator 
#1 to the extension-telephone connection board 21 through the CTI bus 
control circuit 32, the CTI connector 41, and the CTI bus 22. 
[0041] Thus, with the gestalt of this operation, when the operator who 
has TV phone 6 when connecting to the operator having TV phone 6 the 
telephone signal accompanied by the image which carried out Iriki to the 
computer telephony equipment 1 corresponding to video from the telephone 
network 8 cannot respond, after transmitting the message accompanied by 
the image beforehand prepared for the addresser, the message accompanied 
by an image is receivable from an addresser. 

[0042] In addition, although the case where the telephone signal which 
carried out Iriki to the computer telephony equipment 1 corresponding to 
video from the telephone network 8 was constituted so that it may 
connect with the operator having TV phone 6 was explained, a TV phone 
function is given to an operator's terminal 3, and you may make it 
constitute from a gestalt 1 of the above-mentioned implementation. 
[0043] The gestalt 2 of operation of this invention is explained below 
to gestalt 2. of operation with reference to a drawing. Drawing 5 is 
drawing showing the system configuration of the computer telephony 
equipment corresponding to video of the gestalt 2 of operation 
concerning this invention. For a terminal, and 4, 6 and 10, as for an 
analog telephone and 7, in drawing 5 , a TV phone and 5 are [ the 
computer telephony equipment corresponding to video, and 2, 3 and 9/1 
/ LAN and 8 ] telephone networks. The LAN board of the computer 




telephony equipment 1 corresponding to the video by which 19 is 
connected with terminals 2 and 3 through LAN7, and 20 are image audio 
response boards, receive the Iriki telephone signal from a telephone 
network 8, and answer, and 21 is an extension-telephone connection board 
and connects a telephone signal to a wire telephone. 
[0044] Drawing 6 is the block diagram showing the configuration of the 
computer telephony equipment corresponding to the video shown in drawing 
1 . In drawing 6 , for a CPU board and 13, as for a bus bridge board and 
15, the memory board and 14 are [11 and 12 / an I/O-hardware-control 
board and 16 ] system buses, and CPU boards 11 and 12, the memory board 
13, and the bus bridge board 14 perform data transfer through a system 
bus 16. 17 is an I/O bus and the bus bridge board 14, the I/O-hardware- 
control board 15, and the LAN board 19 are connected. 18 is a SCSI bus 
and disk units 23-26 are connected. 22 is a CTI bus and transmits the 
Iriki telephone signal to an operator through the extension-telephone 
connection board 21. 27 is an image recognition board and recognizes the 
image of the telephone signal accompanied by an image. 
[0045] Drawing 3 is the block diagram showing the configuration of the 
image audio response board of the computer telephony equipment 
corresponding to the video shown in drawing 1 . drawing 3 — setting — 
31 — a line control circuit and 32 — a CTI bus control circuit and 33 
— a telephone control circuit and 34 — for memory and 37, as for CPU 
and 39, a bus bridge and 38 are [ an image processing circuit and 35 / a 
speech processing circuit and 36 / memory and 40 ] local bus control 
circuits. 

[0046] 41 is a CTI connector and is connected to the CTI bus control 
circuit 32. 42 is an image voice bus and the telephone control circuit 
33, the image processing circuit 34, the speech processing circuit 35, 
memory 36, and a bus bridge 37 perform data transfer through the image 
voice bus 42. 43 is a local bus and a bus bridge 37, CPU38, memory 39, 
and the local bus control circuit 40 perform data transfer through a 
local bus 43. 44 is an I/O bus and the local bus control circuit 40 is 
connected. 

[0047] Drawing 4 is the block diagram showing the configuration of the 
terminal shown in drawing 1 . As for a CPU board and 52, in drawing 4 , 
51 is [ the memory board and 53 ] bus bridge boards. The disk unit in 
which 54 was connected to the I/O-hardware-control board, and 55 was 
connected to the I/O-hardware-control board 54, and OS was stored, and 
56 are the LAN boards connected to LAN7. 

[0048] Here, when the image of the telephone signal accompanied by the 
image which carried out Iriki to the computer telephony equipment 1 
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corresponding to video is recognized and the addresser has tried 
conversation using sign language from the telephone network 8, the case 
where it connects with the operator who can do sign language is 
explained. 

[0049] If an addresser telephones the computer telephony equipment 1 
corresponding to video from TV phone 4 connected to the telephone 
network 8, the image audio response board 20 of the computer telephony 
equipment 1 corresponding to video will receive the telephone signal 
accompanied by an image. The device driver of the image audio response 
board 20 processes this telephone signal in the telephone control 
circuit 33 through the line control circuit 31 of the image audio 
response board 20, and the CTI bus control circuit 32. 
[0050] The line control circuit 31 buffers an addresser s number 
obtained with addresser telephone number service. The telephone control 
circuit 33 performs separation of an image and voice, when it is a 
telephone signal accompanied by an image. After a video signal is ^ 
decrypted in the image processing circuit 34, it is accumulated in 
memory 36. A sound signal is accumulated in memory 36 as it is. A system 
transmits the video signal accumulated in memory 36 to the image 
recognition board 27 through the telephone control circuit 33, the CTI 
bus control circuit 32, the local bus control circuit 40, and I/O bus 17. 
[0051] The image recognition board 27 analyzes a part with a motion of 
inter-frame [ of an image ], and when it has been recognized that sign 
language is used, it notifies it to a system. A system transmits the 
message accompanied by the image of "since I tie to the operator in whom 
sign language is possible, please wait for a while" to an addresser. The 
device driver of the image audio response board 20 receives the message 
concerned from a system, and in order to transmit it to a telephone 
network 8, specifically, it transmits it to the image audio response 
board 20. 

[0052] Next, the telephone control circuit 33 of the image audio 
response board 20 transmits the message concerned to an addresser 
through the CTI bus control circuit 32 and the line control circuit 31. 
Furthermore, the telephone control circuit 33 directs that the Iriki 
telephone signal connects with TV phone 10 of operator #3 to the 
extension-telephone connection board 21 through the CTI bus control 
circuit 32, the CTI connector 41, and the CTI bus 22. 
[0053] An image until the audio response board 20 of the computer 
telephony equipment 1 corresponding to video connects with TV phone 10 
of operator #3 from the time of receiving the telephone signal 
accompanied by an image After being decrypted in the image processing 



circuit 34, when it continues being accumulated in memory 36 and 
connects with TV phone 10 of operator #3 The image of memory 36 is 
encoded again in the image processing circuit 34, and it transmits to TV 
phone 10 of operator #3 with the voice of memory 36 through the 
telephone control circuit 33, the CTI bus control circuit 32, the CTI 
connector 41, the CTI bus 22, and the extension-telephone connection 
board 21. 

[0054] Moreover, since an addresser is specified as coincidence from an 
addresser' s telephone number, information is retrieved for the customer 
data in a disk unit 24. A system displays this customer data on the 
screen of a terminal 9 by the LAN board 56 course of the LAN board 19, 
LAN7, and the terminal 9 of operator #3. Although an addresser and 
operator #3 start conversation through TV phone 10 at this time, 
operator #3 can respond with an addresser, looking at customer data. The 
data updated by this correspondence are stored in the customer data in a 
disk unit 24. 

[0055] When the operator who can do sign language when the image of the 
telephone signal accompanied by the image which carried out Iriki to the 
computer telephony equipment 1 corresponding to video is recognized and 
the addresser has tried conversation using sign language from the 
telephone network 8 cannot respond, after transmitting the message 
accompanied by the image beforehand prepared for the addresser, the case 
where the message accompanied by an image is received from an addresser 
is explained. 

[0056] If an addresser telephones the computer telephony equipment 1 
corresponding to video from TV phone 4 connected to the telephone 
network 8, the image audio response board 20 of the computer telephony 
equipment 1 corresponding to video will receive the telephone signal 
accompanied by an image. The device driver of the image audio response 
board 20 processes this telephone signal in the telephone control 
circuit 33 through the line control circuit 31 of the image audio 
response board 20, and the CTI bus control circuit 32. 
[0057] The line control circuit 31 buffers an addresser' s number 
obtained with addresser telephone number service. The telephone control 
circuit 33 performs separation of an image and voice, when it is a 
telephone signal accompanied by an image. After a video signal is 
decrypted in the image processing circuit 34, it is accumulated in 
memory 36. A sound signal is accumulated in memory 36 as it is. A system 
transmits the video signal accumulated in memory 36 to the image 
recognition board 27 through the telephone control circuit 33, the CTI 
bus control circuit 32, the local bus control circuit 40, and 1/0 bus 17. 




[0058] The image recognition board 27 analyzes a part with a motion of 
inter-frame [ of an image ], and when it has been recognized that sign 
language is used, it notifies it to a system. A system searches the 
operator state table in a disk unit 25, and checks a log in of the 
operator concerned, and a log off. In this case, the operator concerned 
searches the operator customer data in a disk unit 25 for a log off 
condition next, and checks the existence of the message accompanied by 
the image corresponding to the addresser of this **. 
[0059] In addition, an operator performs a log in and a log off at a 
terminal, when it returns to the time of leaving a seat, and a seat, and 
a system updates suitably reception and the operator state table in a 
disk unit 25 for this information by LAN7 course. Moreover, at a 
terminal 9, an operator creates suitably the message accompanied by the 
image corresponding to a customer registered, and stores in the operator 
customer data in a disk unit 25. 

[0060] "I am sorry when there is no message to the addresser concerned. 
The operator in whom sign language is possible has removed the seat now. 
If there is a message, please give the talk. The message accompanied by 
images, such as ", is transmitted to an addresser. The message 
accompanied by the image in this case is the animation using the image 
transcription message and sign language using the static image of the 
above-mentioned contents prepared beforehand, and sign language. It 
continues at this and the message accompanied by an addresser s image is 
saved at an image voice message box. 

[0061] The device driver of the image audio response board 20 receives 
the message concerned from a system, and in order to transmit it to a 
telephone network 8, specifically, it transmits it to the image audio 
response board 20. Next, the telephone control 33 of the image audio 
response board 20 transmits the message concerned to an addresser 
through the CTI bus control circuit 32 and the line control circuit 31. 
Moreover, the image audio response board 20 receives the message 
accompanied by an addresser s image, and it hands over to a system 
through the line control circuit 31, the CTI bus control circuit 32, and 
the local bus control circuit 40. A system stores the message 
accompanied by the image of this ** in the image voice message box in a 
disk unit 25. 

[0062] "I am sorry when there is a message to the addresser concerned. 
Although the operator in whom sign language is possible has removed the 
seat now, since there is a message addressed to you, please have a look. 
The message accompanied by images, such as ", is transmitted to an 
addresser. The message accompanied by the image in this case is the 




animation using the image transcription message and sign language using 
the static image of the above-mentioned contents prepared beforehand, 
and sign language. 

[0063] The device driver of the image audio response board 20 receives 
the message concerned from a system, and in order to transmit it to a 
telephone network 8, specifically, it transmits it to the image audio 
response board 20. Next, the image audio response board 20 once stores 
the message concerned in memory 36 through the local bus control circuit 
40, the CTI bus control circuit 32, and telephone control circuit 33 **, 
changes it into an image format of a TV phone, and a voice format in the 
image processing circuit 34 and the speech processing circuit 35, and is 
transmitted to an addresser through the telephone control circuit 33, 
the CTI bus control circuit 32, and the line control circuit 31. 
[0064] Furthermore, when an addresser leaves the message accompanied by 
an image, a message, such as "if a message is in operator #2, please 
give the talk", is transmitted to an addresser. The message accompanied 
by the image in this case is the animation using the image transcription 
message and sign language using the still picture of the above-mentioned 
contents prepared beforehand, and sign language. Furthermore, an 
addresser' s message is saved at an image voice message box. The device 
driver of the image audio response board 20 receives the message 
concerned from a system, and in order to transmit it to a telephone 
network 8, specifically, it transmits it to the image audio response 
board 20. 

[0065] Next, the image audio response board 20 once stores the message 
concerned in memory 36 through the local bus control circuit 40, the CTI 
bus control circuit 32, and telephone control circuit 33 **, changes it 
into an image format of a TV phone, and a voice format in the image 
processing circuit 34 and the speech processing circuit 35, and is 
transmitted to an addresser through the telephone control circuit 33, 
the CTI bus control circuit 32, and the line control circuit 31. The 
message accompanied by an addresser s image is processed in the 
telephone control circuit 33 through the line control circuit 31 of the 
image audio response board 20, and the CTI bus control circuit 32. 
[0066] The telephone control circuit 33 performs separation of an image 
and voice, when it is a telephone signal accompanied by an image. After 
a video signal is decrypted in the image processing circuit 34, it is 
accumulated in memory 36. A sound signal is accumulated in memory 36 as 
it is. A system stores the message accompanied by an addresser' s image 
in the image voice message box in reception and a disk unit 25 from the 
image audio response board 20. 




[0067] Thus, when connecting with the operator who can do sign language 
when the image of the telephone signal accompanied by the image which 
carried out Iriki to the computer telephony equipment 1 corresponding to 
video is recognized and the addresser has tried conversation with the 
gestalt of this operation using sign language from the telephone network 
8 and the operator who can do sign language cannot respond, after 
transmitting the message accompanied by the image beforehand prepared 
for the addresser, the message accompanied by an image is receivable 
from an addresser. 

[0068] In addition, although the case where the telephone signal which 
carried out Iriki to the computer telephony equipment 1 corresponding to 
video from the telephone network 8 was constituted so that it may 
connect with the operator having TV phones 6 and 10 was explained, a TV 
phone function is given to an operator' s terminals 3 and 9, and you may 
make it constitute from a gestalt 2 of the above-mentioned 
implementation. 

[0069] The gestalt 3 of operation of this invention is explained below 
to gestalt 3. of operation with reference to a drawing. Since the 
gestalt of this operation is the same as that of the system 
configuration of the computer telephony equipment corresponding to video 
of the gestalt 1 of operation shown in drawing 1 , it explains using 
drawing 1 . For a terminal, and 4 and 6, as for an analog telephone and 
7, in drawing 1 , a TV phone and 5 are [ the computer telephony 
equipment corresponding to video, and 2 and 3 / 1 / LAN and 8 ] 
telephone networks. The LAN board of the computer telephony equipment 1 
corresponding to the video by which 19 is connected with terminals 2 and 
3 through LAN7, and 20 are image audio response boards, receive the 
Iriki telephone signal from a telephone network 8, and answer, and 21 is 
an extension-telephone connection board and connects a telephone signal 
to a wire telephone. 

[0070] Drawing 7 is the block diagram showing the configuration of the 
computer telephony equipment corresponding to the video shown in drawing 
1 . In drawing 7 , for a CPU board and 13, as for a bus bridge board and 
15, the memory board and 14 are [ 11 and 12 / an 1/0-hardware-control 
board and 16 ] system buses, and CPU boards 11 and 12, the memory board 
13, and the bus bridge board 14 perform data transfer through a system 
bus 16. 17 is an I/O bus and the bus bridge board 14, the I/O-hardware- 
control board 15, and the LAN board 19 are connected. 18 is a SCSI bus 
and disk units 23-26 are connected. 22 is a CTI bus and transmits the 
Iriki telephone signal to an operator through the extension-telephone 
connection board 21. 28 is a speech recognition board and recognizes the 



voice of an operator* s telephone signal. 

[0071] Drawing 3 is the block diagram showing the configuration of the 
image audio response board of the computer telephony equipment 
corresponding to the video shown in drawing 1 . drawing 3 — setting 
31 — a line control circuit and 32 — a CTI bus control circuit and 33 
— a telephone control circuit and 34 — for memory and 37, as for CPU 
and 39, a bus bridge and 38 are [ an image processing circuit and 35 / a 
speech processing circuit and 36 / memory and 40 ] local bus control 
circuits. 

[0072] 41 is a CTI connector and is connected to the CTI bus control 
circuit 32. 42 is an image voice bus and the telephone control circuit 
33, the image processing circuit 34, the speech processing circuit 35, 
memory 36, and a bus bridge .37 perform data transfer through the image 
voice bus 42. 43 is a local bus and a bus bridge 37, CPU38, memory 39, 
and the local bus control circuit 40 perform data transfer through a 
local bus 43. 44 is an I/O bus and the local bus control circuit 40 is 
connected. 

[0073] Drawing 4 is the block diagram showing the configuration of the 
terminal shown in drawing 1 . As for a CPU board and 52, in drawing 4 , 
51 is [ the memory board and 53 ] bus bridge boards. The disk unit in 
which 54 was connected to the 1/0-hardware-control board, and 55 was 
connected to the I/O-hardware-control board 54, and OS was stored, and 
56 are the LAN boards connected to LAN7. 

[0074] Here, the case where connect to the operator having TV phone 6 
the telephone signal accompanied by the image which carried out Iriki to 
the computer telephony equipment 1 corresponding to video, carry out 
[ voice / of an operator ] speech recognition, compound a speech 
recognition result on an image, and it transmits to an addresser from a 
telephone network 8 is explained. 

[0075] If an addresser telephones computer telephony equipment 1 from TV 
phone 4 connected to the telephone network 8, the audio response board 
20 of the computer telephony equipment 1 corresponding to video will 
receive the telephone signal accompanied by an image. The device driver ■ 
of the image audio response board 20 processes the telephone signal 
accompanied by this image in the telephone control circuit 33 through 
the line control circuit 31 of the image audio response board 20, and 
the CTI bus control circuit 32. 

[0076] The line control circuit 31 buffers an addresser s number 
obtained with addresser telephone number service. The telephone control 
circuit 33 performs separation of an image and voice, when it is a 
telephone signal accompanied by an image. After a video signal is 



decrypted in the image processing circuit 34, it is accumulated in 
memory 36. A sound signal is accumulated in memory 36 as it is. Next, 
the telephone control circuit 33 directs that the Iriki telephone signal 
connects with TV phone 6 of operator #2 to the extension-telephone 
connection board 21 through the CTI bus control circuit 32, the CTI 
connector 41, and the CTI bus 22. 

[0077] An image until the audio response board 20 of the computer 
telephony equipment 1 corresponding to video connects the telephone 
signal accompanied by an image to TV phone 6 of operator #2 from the 
time of receiving After being decrypted in the image processing circuit 
34, when it continues being accumulated in memory 36 and connects with 
TV phone 6 of operator #2 The image of memory 36 is encoded again in the 
image processing circuit 34, and it transmits to TV phone 6 of operator 
#2 with the voice of memory 36 through the telephone control circuit 33, 
the CTI bus control circuit 32, the CTI connector 41, the CTI bus 22, 
and the extension-telephone connection board 21. 

[0078] Moreover, since an addresser is specified as coincidence from an 
addresser' s telephone number, information is retrieved for the customer 
data in a disk unit 24. A system displays this customer data on the 
screen of a terminal 3 by the LAN board 56 course of the LAN board 19, 
LAN7, and the terminal 3 of operator #2. Although an addresser and 
operator #2 start conversation through TV phone 6 at this time, the 
telephone signal accompanied by the image of operator #2 is transmitted 
to the image audio response board 20 through the extension connection 
board 21 and 1/0 bus 17, and is processed in the telephone control 
circuit 33 through the local bus control circuit 40 and the CTI bus 
control circuit 32. 

[0079] The telephone control circuit 33 performs separation of an image 
and voice, when it is a telephone signal accompanied by an image. After 
a video signal is decrypted in the image processing circuit 34, it is 
accumulated in memory 36. After a sound signal is decrypted in the 
speech processing circuit 34, it is accumulated in memory 36. A system 
transmits the voice stored in memory 36 to the speech recognition board 
28 through the telephone control circuit 33, the CTI bus control circuit 
32, the local bus control circuit 40, and I/O bus 17. 
[0080] The speech recognition board 28 recognizes voice and returns it 
to the image audio response board 20 as a character string. The device 
driver of the image audio response board 20 compounds with the image of 
operator #2 in which the speech recognition result (character string) 
was stored by memory 36. Furthermore, it changes into an image format of 
a TV phone, and a voice format in the image processing circuit 34 and 




the speech processing circuit 35, and transmits to an addresser through 
the telephone control circuit 33, the CTI bus control circuit 32, and 
the line control circuit 31. 

[0081] Thus, with the gestalt of this operation, from a telephone 
network 8, the telephone signal accompanied by the image which carried 
out Iriki to the computer telephony equipment 1 corresponding to video 
can be connected to the operator having TV phone 6, speech recognition 
can be carried out [ voice / of an operator ], a speech recognition 
result can be compounded on an image, and it can transmit to an 
addresser. 

[0082] In addition, although the case where the telephone signal which 
carried out Iriki to the computer telephony equipment 1 corresponding to 
video from the telephone network 8 was constituted so that it may 
connect with the operator having TV phone 6 was explained, a TV phone 
function is given to an operator' s terminal 3, and you may make it 
constitute from a gestalt 3 of the above-mentioned implementation. 
[0083] The gestalt 4 of operation of this invention is explained below 
to gestalt 4. of operation with reference to a drawing. Since the 
gestalt of this operation is the same as that of the system 
configuration of the computer telephony equipment corresponding to video 
of the gestalt 1 of operation shown in drawing 1 , it explains using 
drawing 1 . For a terminal, and 4 and 6, as for an analog telephone and 
7, in drawing 1 , a TV phone and 5 are [ the computer telephony 
equipment corresponding to video, and 2 and 3 / 1 / LAN and 8 ] 
telephone networks. The LAN board of the computer telephony equipment 1 
corresponding to the video by which 19 is connected with terminals 2 and 
3 through LAN7, and 20 are image audio response boards, receive the 
Iriki telephone signal from a telephone network 8, and answer, and 21 is 
an extension-telephone connection board and connects a telephone signal 
to a wire telephone. 

[0084] Drawing 8 is the block diagram showing the configuration of the 
computer telephony equipment corresponding to the video shown in drawing 
1 . In drawing 8 , for a CPU board and 13, as for a bus bridge board and 
15, the memory board and 14 are [ 11 and 12 / an I/O-hardware-control 
board and 16 ] system buses, and CPU boards 11 and 12, the memory board 
13, and the bus bridge board 14 perform data transfer through a system 
bus 16. 

[0085] 17 is an I/O bus and the bus bridge board 14, the I/O-hardware- 
control board 15, and the LAN board 19 are connected. 18 is a SCSI bus 
and disk units 23-26 are connected. 22 is a CTI bus and transmits the 
Iriki telephone signal to an operator through the extension-telephone 



connection board 21. 28 is a speech recognition board, and the voice of 
an operator' s telephone signal is recognized, and 29 is a sign language 
recognition board and recognizes an addresser' s sign language. 
[0086] Drawing 3 is the block diagram showing the configuration of the 
image audio response board of the computer telephony equipment 
corresponding to the video shown in drawing 1 . drawing 3 — setting — 
31 — a line control circuit and 32 — a CTI bus control circuit and 33 
— a telephone control circuit and 34 — for memory and 37, as for CPU 
and 39, a bus bridge and 38 are [ an image processing circuit and 35 / a 
speech processing circuit and 36 / memory and 40 ] local bus control 
circuits. 

[0087] 41 is a CTI connector and is connected to the CTI bus control 
circuit 32. 42 is an image voice bus and the telephone control circuit 
33; the image processing circuit 34, the speech processing circuit 35, 
memory 36, and a bus bridge 37 perform data transfer through the image 
voice bus 42. 43 is a local bus and a bus bridge 37, CPU38, memory 39, 
and the local bus control circuit 40 perform data transfer through a 
local bus 43. 44 is an 1/0 bus and the local bus control circuit 40 is 
connected. 

[0088] Drawing 4 is the block diagram showing the configuration of the 
terminal shown in drawing 1 . As for a CPU board and 52, in drawing 4 , 
51 is [ the memory board and 53 ] bus bridge boards. The disk unit in 
which 54 was connected to the 1/0-hardware-control board, and 55 was 
connected to the I/O-hardware-control board 54, and OS was stored, and 
56 are the LAN boards connected to LAN7. 

[0089] The case where recognize the sign language contained in the image 
of the telephone signal accompanied by the image which carried out Iriki 
to the computer telephony equipment 1 corresponding to video, compound 
the recognition result (character string) of sign language on the image 
transmitted to an operator, carry out [ voice / of an operator ] speech 
recognition, compound a speech recognition result (character string) on 
an image, and it transmits to an addresser from a telephone network 8 
here is explained. 

[0090] If an addresser telephones the computer telephony equipment 1 
corresponding to video from TV phone 4 connected to the telephone 
network 8, the image audio response board 20 of the computer telephony 
equipment 1 corresponding to video will receive the telephone signal 
accompanied by an image. The device driver of the image audio response 
board 20 processes this telephone signal in the telephone control 
circuit 33 through the line control circuit 31 of the image audio 
response board 20, and the CTI bus control circuit 32. 
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[0091] The line control circuit 31 buffers an addresser* s number 
obtained with addresser telephone number service. The telephone control 
circuit 33 performs separation of an image and voice, when it is a 
telephone signal accompanied by an image. After a video signal is 
decrypted in the image processing circuit 34, it is accumulated in 
memory 36. A sound signal is accumulated in memory 36 as it is. A system 
transmits the video signal accumulated in memory 36 to the sign language 
recognition board 29 through the telephone control circuit 33, the CTI 
bus control 32, the local bus control 40, and I/O bus 17. 
[0092] The sign language recognition board 29 recognizes the sign 
language contained in an image, and transmits a recognition result 
(character string) to the image audio response board 20. The device 
driver of the image audio response board 20 compounds a recognition 
result (character string) to the video signal accumulated in memory 36. 
A device driver directs that the Iriki telephone signal connects with TV 
phone 6 of operator #2 to the extension-telephone connection board 21 
through the CTI bus control circuit 32, the CTI connector 41, and the 
CTI bus 22. 

[0093] An image until the audio response board 20 of the computer 
telephony equipment 1 corresponding to video connects the telephone 
signal accompanied by an image to TV phone 6 of operator #2 from the 
time of receiving After being decrypted in the image processing circuit 
34, when it is accumulated in memory 36, the recognition result 
(character string) of sign language is compounded further and it 
connects with TV phone 6 of operator #2 The image of memory 36 is 
encoded again in the image processing circuit 34, and it transmits to TV 
phone 6 of operator #2 with the voice of memory 36 through the telephone 
control circuit 33, the CTI bus control circuit 32, the CTI connector 41, 
the CTI bus 22, and the extension-telephone connection board 21. 
[0094] Moreover, since an addresser is specified as coincidence from an 
addresser* s telephone number, information is retrieved for the customer 
data in a disk unit 24. A system displays this customer data on the 
screen of a terminal 3 by the LAN board 56 course of the LAN board 19, 
LAN7, and the terminal 3 of operator #2. Although an addresser and 
operator #2 start conversation through TV phone 6 at this time, the 
telephone signal accompanied by the image of operator #2 is transmitted 
to the image audio response board 20 through the extension connection 
board 21 and I/O bus 17, and is processed in the telephone control 
circuit 33 through the local bus control circuit 40 and the CTI bus 
control circuit 32. 

[0095] The telephone control circuit 33 performs separation of the image 




of a telephone signal, and voice accompanied by the image from operator 
#2. After a video signal is decrypted in the image processing circuit 34, 
it is accumulated in memory 36. After a sound signal is decrypted in the 
speech processing circuit 34, it is accumulated in memory 36. A system 
transmits the voice stored in memory 36 to the speech recognition board 
28 through the telephone control circuit 33, the CTI bus control circuit 
32, the local bus control circuit 40, and I/O bus 17. 
[0096] The speech recognition board 28 recognizes voice and returns it 
to the image audio response board 20 as a character string. The device 
driver of the image audio response board 20 compounds with the image of 
operator #2 in which the speech recognition result (character string) 
was stored by memory 36. Furthermore, it changes into an image format of 
a TV phone, and a voice format in the image processing circuit 34 and 
the speech processing circuit 35, and transmits to an addresser through 
the telephone control circuit 33, the CTI bus control circuit 32, and 
the line control circuit 31. 

[0097] The recognition result (character string) of sign language 
superimposes an addresser' s sign language like a title to the screen 
down side of TV phone 6 while projecting it on the screen of TV phone 6 
of operator #2. Operator #2 correspond to an addresser, looking at the 
recognition result (character string) of this sign language. To the 
screen down side of an addresser' s TV phone, the speech recognition 
result (character string) of the voice of operator #2 superimposes like 
a title. 

[0098] Thus, with the gestalt 4 of this operation, from a telephone 
network 8, the sign language contained in the image of the telephone 
signal accompanied by the image which carried out Iriki to the computer 
telephony equipment 1 corresponding to video is recognized, the 
recognition result (character string) of sign language is compounded on 
the image transmitted to an operator, speech recognition can be carried 
out [ voice / of an operator ], a speech recognition result (character 
string) can be compounded on an image, and it can transmit to an 
addresser. 

[0099] In addition, although the case where the telephone signal which 
carried out Iriki to the computer telephony equipment 1 corresponding to 
video from the telephone network 8 was constituted so that it may 
connect with the operator having TV phone 6 was explained, a TV phone 
function is given to an operator' s terminal 3, and you may make it 
constitute from a gestalt 4 of the above-mentioned implementation. 
[0100] Moreover, it constituted from a gestalt 4 of the above-mentioned 
implementation so that the recognition result (character string) of an 



addresser's sign language might be superimposed like a title to the 
screen down side of an operator* s TV phone 6, but you may constitute so 
that an addresser* s sign language recognition result (character string) 
may be displayed on the screen of an operator' s terminal 3. 
[0101] The gestalt 5 of operation of this invention is explained below 
to gestalt 5. of operation with reference to a drawing. Since the 
gestalt of this operation is the same as that of the system 
configuration of the computer telephony equipment corresponding to video 
of the gestalt 1 of operation shown in drawing 1 , it explains using 
drawing 1 . For a terminal, and 4 and 6, as for an analog telephone and 
7, in drawing 1 , a TV phone and 5 are [ the computer telephony 
equipment corresponding to video, and 2 and 3 / 1 / LAN and 8 ] 
telephone networks. The LAN board of the computer telephony equipment 1 
corresponding to the video by which 19 is connected with terminals 2 and 
3 through LAN7, and 20 are image audio response boards, receive the 
Iriki telephone signal from a telephone network 8, and answer, and 21 is 
an extension-telephone connection board and connects a telephone signal 
to a wire telephone. 

[0102] Drawing 9 is the block diagram showing the configuration of the 
computer telephony equipment corresponding to the video shown in drawing 
1 . In drawing 9 , for a CPU board and 13, as for a bus bridge board and 
15, the memory board and 14 are [ 11 and 12 / an 1/0-hardware-control 
board and 16 ] system buses, and CPU boards 11 and 12, the memory board 
13, and the bus bridge board 14 perform data transfer through a system 
bus 16. 

[0103] 17 is an 1/0 bus and the bus bridge board 14, the 1/0-hardware- 
control board 15, and the LAN board 19 are connected. 18 is a SCSI bus 
and disk units 23-26 are connected. 22 is a CTI bus and transmits the 
Iriki telephone signal to an operator through the extension-telephone 
connection board 21. 28 is a speech recognition board, and the voice of 
an operator* s telephone signal is recognized, and 29 is a sign language 
recognition board and recognizes an addresser* s sign language. 30 is a 
speech synthesis board and changes a character string into voice. 
[0104] Drawing 3 is the block diagram showing the configuration of the 
image audio response board of the computer telephony equipment 
corresponding to the video shown in drawing 1 . drawing 3 — setting — 
31 — a line control circuit and 32 — a CTI bus control circuit and 33 
— a telephone control circuit and 34 — for memory and 37, as for CPU 
and 39, a bus bridge and 38 are [ an image processing circuit and 35 / a 
speech processing circuit and 36 / memory and 40 ] local bus control 
circuits. 




[0105] 41 is a CTI connector and is connected to the CTI bus control 
circuit 32. 42 is an image voice bus and the telephone control circuit 
33, the image processing circuit 34, the speech processing circuit 35, 
memory 36, and a bus bridge 37 perform data transfer through the image 
voice bus 42. 43 is a local bus and a bus bridge 37, CPU38, memory 39, 
and the local bus control circuit 40 perform data transfer through a 
local bus 43. 44 is an I/O bus and the local bus control circuit 40 is 
connected. 

[0106] Drawing 4 is the block diagram showing the configuration of the 
terminal shown in drawing 1 . As for a CPU board and 52, in drawing 4 , 
51 is [ the memory board and 53 ] bus bridge boards. The disk unit in 
which 54 was connected to the 1/0-hardware-control board, and 55 was 
connected to the I/O-hardware-control board 54, and OS was stored, and 
56 are the LAN boards connected to LAN7. 

[0107] While compounding on the image which recognizes the sign language 
contained in the image of the telephone signal accompanied by the image 
which carried out Iriki to the computer telephony equipment 1 
corresponding to video, and transmits the recognition result (character 
string) of sign language to an operator from a telephone network 8 here 
The case where compound to the voice which synthesizes voice from the 
recognition result (character string) of sign language, and transmits to 
an operator, carry out [ voice / of an operator ] speech recognition, 
compound a speech recognition result (character string) on an image, and 
it transmits to an addresser is explained. 

[0108] If an addresser telephones the computer telephony equipment 1 
corresponding to video from TV phone 4 connected to the telephone 
network 8, the image audio response board 20 of the computer telephony 
equipment 1 corresponding to video will receive the telephone signal 
accompanied by an image. The device driver of the image audio response 
board 20 processes this telephone signal in the telephone control 
circuit 33 through the line control circuit 31 and the CTI bus control 
circuit 32 of the image audio response board 20. The line control 
circuit 31 buffers an addresser' s number obtained with addresser 
telephone number service. 

[0109] The telephone control circuit 33 performs separation of an image 
and voice, when it is a telephone signal accompanied by an image. After 
a video signal is decrypted in the image processing circuit 34, it is 
accumulated in memory 36. After a sound signal is decrypted in the 
speech processing circuit 35, it is accumulated in memory 36. A system 
transmits the video signal accumulated in memory 36 to the sign language 
recognition board 29 through the telephone control circuit 33, the CTI 




bus control 32, the local bus control 40, and I/O bus 17. The sign 
language recognition board 29 recognizes the sign language contained in 
an image, and transmits a recognition result (character string) to the 
image audio response board 20. 

[0110] The device driver of the image audio response board 20 compounds 
a recognition result (character string) to the video signal accumulated 
in memory 36. Next, a device driver transmits a recognition result 
(character string) to the speech synthesis board 29 through the 
telephone control circuit 33, the CTI bus control 32, the local bus 
control 40, and 1/0 bus 17. The speech synthesis board 29 changes a 
recognition result (character string) into a sound signal, and transmits 
it to the image audio response board 20. The device driver of the image 
audio response board 20 compounds the received sound signal to the sound 
signal accumulated in memory 36. 

[0111] A device driver directs that the Iriki telephone signal connects 
with TV phone 6 of operator #2 to the extension-telephone connection 
board 21 through the CTI bus control circuit 32, the CTI connector 41, 
and the CTI bus 22. After an image and voice until the audio response 
board 20 of the computer telephony equipment 1 corresponding to video 
connects the telephone signal accompanied by an image to TV phone 6 of 
operator #2 from the time of receiving are decrypted in the image 
processing circuit 34 or the speech processing circuit 35, it is 
accumulated in memory 36, the recognition result (character string) of 
sign language is compounded by the image, and what synthesized voice 
from the recognition result (character string) of sign language is 
compounded by voice. Then, when it connects with TV phone 6 of operator 
#2, it encodes again in the image processing circuit 34 or the speech 
processing circuit 35, and memory 36 image and voice are transmitted to 
TV phone 6 of operator #2 through the telephone control circuit 33, the 
CTI bus control circuit 32, the CTI connector 41, the CTI bus 22, and 
the extension-telephone connection board 21. 

[0112] Moreover, since an addresser is specified as coincidence from an 
addresser's telephone number, information is retrieved for the customer 
data in a disk unit 24. A system displays this customer data on the 
screen of a terminal 3 by the LAN board 56 course of the LAN board 19, 
LAN7, and the terminal 3 of operator #2. Although an addresser and 
operator #2 start conversation through TV phones 4 and 6 at this time, 
the telephone signal accompanied by the image of operator #2 is 
transmitted to the image audio response board 20 through the extension 
connection board 21 and 1/0 bus 17, and is processed in the telephone 
control circuit 33 through the local bus control circuit 40 and the CTI 
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bus control circuit 32. 
[0113] The telephone control circuit 33 performs separation of the image 
of a telephone signal, and voice accompanied by the image from operator 
#2. After a video signal is decrypted in the image processing circuit 34, 
it is accumulated in memory 36. After a sound signal is decrypted in the 
speech processing circuit 35, it is accumulated in memory 36. A system 
transmits the voice stored in memory 36 to the speech recognition board 
28 through the telephone control circuit 33, the CTI bus control circuit 
32, the local bus control circuit 40, and I/O bus 17. 
[0114] The speech recognition board 28 recognizes voice and returns it 
to the image audio response board 20 as a character string. The device 
driver of the image audio response board 20 compounds with the image of 
operator #2 in which the speech recognition result (character string) 
was stored by memory 36. Furthermore, it changes into an image format of 
a TV phone, and a voice format in the image processing circuit 34 and 
the speech processing circuit 35, and transmits to an addresser through 
the telephone control circuit 33, the CTI bus control circuit 32, and 
the line control circuit 31. 

[0115] It synthesizes voice from the recognition result of sign language, 
and an addresser' s sign language can be heard from TV phone 6 with voice 
while projecting it on the screen of TV phone 6 of operator #2 and the 
recognition result (character string) of sign language superimposes it 
like a title to the screen down side of TV phone 6. Operator #2 
correspond to an addresser, hearing the voice compounded while looking 
at the recognition result (character string) of this sign language. To 
the screen down side of an addresser' s TV phone 4, the speech 
recognition result (character string) of the voice of operator #2 
superimposes like a title. 

[0116] Thus, an addresser' s sign language contained in the image of the 
telephone signal accompanied by the image which carried out Iriki to the 
computer telephony equipment 1 corresponding to video from the telephone 
network 8 with the gestalt of this operation is recognized. While 
compounding the recognition result (character string) of sign language 
on the image transmitted to an operator, it compounds to the voice which 
synthesizes voice from the recognition result (character string) of sign 
language, and transmits to an operator, and speech recognition can be 
carried out [ voice / of an operator ], a speech recognition result 
(character string) can be compounded on an image, and it can transmit to 
an addresser. 

[0117] In addition, although the case where the telephone signal which 
carried out Iriki to the computer telephony equipment 1 corresponding to 




video from the telephone network 8 was constituted so that it may 
connect with the operator having TV phone 6 was explained, a TV phone 
function is given to an operator' s terminal 6, and you may make it 
constitute from a gestalt 5 of the above-mentioned implementation. 
[0118] Moreover, it constituted from a gestalt 5 of the above-mentioned 
implementation so that the recognition result (character string) of an 
addresser's sign language might be superimposed like a title to the 
screen down side of an operator's TV phone 6, but you may constitute so 
that an addresser' s sign language recognition result (character string) 
may be displayed on the screen of an operator' s terminal 3. 
[0119] 

[Effect of the Invention] It. is effective in the ability of an operator 
to be able to talk with an addresser using an image and voice by 
constituting so that it may have a telephone-signal receiving means to 
receive the telephone signal accompanied by the image which carries out 
Iriki from a telephone network, a telephone-signal response means to 
answer based on the telephone signal accompanied by the received image, 
and the telephone-signal connecting means that connects the telephone 
signal accompanied by the received image to an operator according to 
invention according to claim 1. 

[0120] In case an image recognition means to recognize the image which 
carries out Iriki from a telephone network, and the telephone signal 
accompanied by the received image are connected to an operator according 
to invention according to claim 2, it is effective in the ability to 
carry out automatic connection to an operator according to the contents 
of the image by constituting so that it may have the telephone-signal 
automatic connecting means which carries out automatic connection to an 
operator based on the contents of the recognized image. 
[0121] When an operator' s voice has been recognized by constituting so 
that it may have a speech recognition means to recognize an operator' s 
voice, and a speech recognition result composition means to compound a 
speech recognition result on the image transmitted to an addresser when 
an operator' s voice has been recognized according to invention according 
to claim 3, the effectiveness that a speech recognition result is 
compoundable is in the image transmitted to an addresser. 
[0122] In case the telephone signal accompanied by an image connects to 
an operator by carrying out the cause like this so that it may have a 
sign-language recognition means recognize the sign language contained in 
the image which carries out Iriki from a telephone network, and a sign- 
language recognition result composition means compound the recognized 
sign-language recognition result on an image in case the telephone 





signal accompanied by an image is connected to an operator according to 
invention according to claim 4, it is effective in a sign-language 
recognition result being compoundable on an image. 
[0123] The 1st speech synthesis means which compounds voice from a 
character string according to invention according to claim 5, A sign 
language recognition means to recognize the sign language contained in 
the image which carries out Iriki from a telephone network, In case a 
telephone signal is connected to an operator, it synthesizes voice with 
the 1st speech synthesis means from the sign language recognition result 
recognized by the sign language recognition means. By constituting so 
that it may have the 2nd speech synthesis means compounded to the voice 
of the telephone signal which carried out [ voice / this / that was 
compounded ] Iriki In case a telephone signal is connected to an 
operator, speech synthesis is performed from a sign language recognition 
result, and it is effective in being compoundable to the voice of the 
telephone signal which carried out [ voice / which was compounded ] 
Iriki. 
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DESCRIPTION OF DRAWINGS 



[Brief Description of the Drawings] 

[Drawing 1] It is drawing showing the system configuration of the 
computer telephony equipment corresponding to video of the gestalt 1 of 
operation concerning this invention. 

[Drawing 2] It is the block diagram showing the configuration of the 
computer telephony equipment corresponding to the video shown in drawing 
1 . 

[Drawing 3] It is the block diagram showing the configuration of the 
image audio response board of the computer telephony equipment 




corresponding to the video shown in drawing 1 . 

[Drawing 4] It is the block diagram showing the configuration of the 
terminal shown in drawing 1 . 

[Drawing 5] It is drawing showing the system configuration of the 
computer telephony equipment corresponding to video of the gestalt 2 of 
operation concerning this invention. 

[Drawing 6] It is the block diagram showing the configuration of the 
computer telephony equipment corresponding to the video shown in drawing 
1 . 

[Drawing 7] It is the block diagram showing the configuration of the 
computer telephony equipment corresponding to the video shown in drawing 
1 . 

[Drawing 8] It is the block diagram showing the configuration of the 
computer telephony equipment corresponding to the video shown in drawing 
1 . 

[Drawing 9] It is the block diagram showing the configuration of the 
computer telephony equipment corresponding to the video shown in drawing 
1 . 

[Drawing 10] It is the schematic diagram showing the reception structure 
of a system shown in conventional JP, 9-163031, A. 
[Description of Notations] 

1 2 Computer Telephony Equipment corresponding to Video, 3 Terminal, 4 
Six A telephone, 7 LAN, 8 11 A telephone network, 12 CPU board, 13 The 
memory board, 14 A bus bridge board, 15 I/O-hardware-control board, 16 A 
system bus, 17 An I/O bus, 18 SCSI bus, 19 A LAN board, 20 An image 
audio response board, 21 Extension-telephone connection board, 22 A CTI 
bus, 23-26 A disk unit, 27 Image recognition board, 28 A speech 
recognition board, 29 A sign language recognition board, 31 Line control 
circuit, 32 A CTI bus control circuit, 33 A telephone control circuit, 
34 Image processing circuit, 35 A speech processing circuit, 36 Memory, 
37 A bus bridge, 38 CPU, 39 Memory, 40 A local bus control circuit, 51 A 
CPU board, 52 The memory board, 53 An I/O bridge, 54 An I/O-hardware- 
control board, 55 A disk unit, 56 LAN board. 
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